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(54) Abstract Title , 

Comparison of colour of articles 

(57) A system for detecting the colour of an article such as a carpet or fabric, comparing with reference data, 
and deriving the colour or texture required for a second matching or complementary article, includes a 
scanning camera 14 adjacent the article 13. The camera supplies data relating to hue, tone and/or light 
intensity to a processor 18 which compares the data with stored information and provides output information 
to enable selection of matching or complementary articles. 
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METHOD AND APPARATUS FOR COMPARISONS 



This invention relates to method and apparatus for comparisons and in 
particular comparison of colour an article. On addition it can be used not 
only in respect of the colour of the article but its appearance in terms of 
type or form of surface texture. It is particularly concerned with 
comparison of an article falling in a family of articles comprising: carpet or 
other flooring material, wall covering of paper, fabric or other material; 
paint; or furnishing fabric (including curtaining). Hereafter such a family 
will be referred to as a being 'of the type described". 

In my co-pending application 9901960.6 there is described method and 
apparatus involving comparison of colour scales. According to a first 
aspect of that invention there is provided a method of generating colour 
based information originating, from a sample comprising the steps of: 
putting the sample into a condition where it can be scanned to provide 
consistent colour and light information in the form of parameters (such as 
information relating to hue, tone and light intensity); scanning the sample 
to establish first value/s of the required parameter/s according to a given 
first range of such parameters; generating from the first value/s second 
value/ s of the parameter/s lying in a second range of such parameters 
either on the basis of a one-to-one relationship between at least a part of 
the first range and the second range or on the basis of some other 
relationship or relationships between the first and second range; 
displaying some or all of the first value/s or the second value/s or of 
functions of the first or second values or combinations of the first and 
second values or of functions thereof either directly or in the form of a 
virtual or other image. 

For the present invention there has been developed a method and 
apparatus for comparing colour and other appearance information. It is 



particularly concerned with the provision of a user friendly system which 
can be used in a retail environment. 



According to a first aspect of the present invention there is provided a 
method of providing information relating to the appearance of a first 
coloured article falling in the family of the type described to enable a 
second coloured article from the family to be selected or identified which 
can be related in a predetermined way to the first comprising the steps of: 

1 scanning the first article to establish colour and light information and 
thereafter to provide an output in the form of derived information 
giving at least one of the parameters defining hue, tone and light 
intensity; 

2 relating the derived information to established parameter or parameters 
located in one or more-ranges of such parameters to identify the 
required parameter or parameters of the second article is either by 
direct correspondence or by way of a predetermined range of such 
parameters such as provided by a colour circle or a range of colours in 
the visible light spectrum; the relationship between the colour/ light 
information of the second article relative to the first being one being 
either identity, partial identity or a relationship such as being 
complementary or contrasting colour. Typically the step of relating the 
derived information to established parameter or parameters can either 
be by way of comparison with information stored as data or with 
information in the form of physical samples such as colour samples of 
fibrous material such as Chromatone (RTM). 

According to a first preferred version of the first aspect of the present 
invention there is provided the in the scanning stage the step of 
establishing parameters for other aspects of the appearance of the first 
coloured article such as type and form of surface texture, whether the 
appearance lies somewhere on a scale extending between mat or glossy, 



between metallic or dull, between coarse or fine weave or some other 
visually significant attribute. 

According to a second aspect of the present invention there is provided 
apparatus for undertaking the method of the first step comprising: 
a locating means adapted to locate the first article; 
a scanner mounted relative to the locating means and adapted to 
scan a first article and to provide the derived output "information; 
a processing means adapted to receive the derived information and 
to relate the established parameter or parameters to one or more 
ranges of such parameters either by direct comparison with a 
physical sample or with entries in a range of such parameters held 
as a data base to identify the required parameter or parameters of 
the second article as aforesaid. 

According to a first preferred version of the second aspect of the present 
invention the processing means involves the Chromatone (RTM) colour 
scale whether in terms of physical samples from a range of such or in the 
form of a data base. 

An exemplary embodiment of the invention will now be described with 
reference to the accompanying -drawing of a colour comparison apparatus 
in the form of a block diagram. 

Comparison apparatus 11 comprises a working head 12 adapted to locate 
an article 13, in this case a piece of carpet. The article 13 is being scanned in 
order to identify further coloured articles with which it is to be used 
namely a curtain fabric of comparable colour; a wall paint of 
complementary cover and a decorative wall paper border in a contrasting 
colour. 



Scanner 14 is mounted above the working head 12 and incorporates a 
spectrophotometer 16 which scans the light reflective values of the sample 
12 as a sequence of parameters identifying hue, tone and light intensity, 
which provides to input channel 17 to processor 18 quantitative 
information in the form of parameter values for hue, tone and light 
intensity of the scanned article 13. In an alternative embodiment the 
scanner can include a digital scanning device such as a digital camera or a 
flat bed scanner (rather than a spectrophotometer) which is adapted to 
provide a digital signal sequence representative of the hue, tone and light 
intensity of the sample and including lighting means to illuminate the 
sample so as to ensure the provision of reproducible results. 

Processor 18 receives information from the input channel 17 and processes 
it to obtain further information appropriate to the requirements for the 
second article or articles. The processor 18 is programmed to automatically 
process output the further information on output channel 19 to a 
conventional video display unit 20, The processor 18 can be also be 
interrogated and caused to process data in a required manner by an 
inputting device such as keyboard 21. 

The processor 18 is equipped with data tables and application software. 
One data table serves to include parameters of the colour system known as 
Chromatone (RTM) and to provide from the information derived from the 
receptor 16 the parameters of the corresponding colour. A further data 
table relates to a colour circle which provides a ring of parameters relating 
particularly to hue. Given a location on the colour circle of the original 
given hue as sensed by the receptor 16 the colour diametrically opposite 
the original colour is defined as the complementary colour, In addition 
given the original colour two colours located on the colour circle 
equidistant from the original colour and from one another provide two 
colours complementary to the original colour. Other relationships can be 



established as required in order to relate an original colour to one or more 
other colours. The colour or colours derived by this process can be 
displayed on VDU 20 which is operated so as to ensure accurate 
reproduction of colours. 

The scanner 14 provides for operation in two different ways. Firstly to 
relate the parameters of what is scanned to parameters already stored in 
one or more databases contained in, or otherwise accessible by, the 
processor 18. Alternatively the scanner can be used to scan in turn a 
proffered sample of unknown parameters followed by a scan of a standard 
sample, for example sample X selected from Chromatone (RTM) sample 
set Z to establish parameter values for the proffered sample 

The processor 18 is linked to a computer C a file server which is also used 
to run applications relating to the retailing side of a business making use of 
the present invention. In this way output from the processor 18 can be 
used to establish information as to the location, availability, amount and 
cost of a selected second product If necessary the computer C can be used 
to undertake processing of an order for the selected second product and to 
deal with associated matters such as re-ordering replacement stock for 
goods shipped out. In addition the computer C can be further used to 
analyse, for example, the use to which processor 18 is put so that ordering 
patterns can be established and the relative popularity of a given product 
or range of products can be identified and where necessary acted on. 

Further data bases are provided in processor 18 to enable information 
derived from the scanning process can be stored and processed. Thus 
further colour scales can be incorporated to enable the colour of the 
original sample 13 or derivatives of it to be identified in terms of 
appropriate colour scales for a products. 



In this case the carpet sample 13 is evaluated in terms of the established 
Chromatone (RTM) scale. This can be converted into other established 
scales such as Dulux (RTM) for paint or Pantone (RTM) for paper or 
derived scales. Further databases can be used to establish, for example, 
stockists, stock locations and amounts of stock of the required material. 
The exemplary embodiment has specified selection by colour relationships 
between articles. However the invention enables other visually significant 
factors to be taken into account given that one or more parameters can be 
identified to serve to define it in quantitative terms. Thus materials can be 
grouped by some feature of surface appearance apart from or in addition 
to colour. Thus a selection can be made depending on a carpet pile type, 
finish varying between mat and glossy, between metallic and dull, fine and 
coarse weave, finish simulating ranges of wood, cork or other materials 
and so on. 

The VDU can also be used to display samples of the selected material 
shown in a virtual environment to enable a viewer to see the likely effect of 
the juxtaposition of two or more selected materials. Such virtual displays 
can include the effect of varying lighting conditions for example: daylight 
and artificial light; daylight at different times of the day. 



A feature of the invention is the provision of a colour comparing and 
matching system which can be readily used to advantage in a retail 
environment to readily provide a useful and readily understood service 
and demonstration to a customer enabling them to obtain on presenting 
either from a description, or a sample, of a item from the family as 
aforesaid information. The system readily provides for additional features, 
if desired, say the submission of an order, for a product or products and 
information relating to the product. The invention further enables the 
required product or products to be demonstrated in a virtual typical 
environment under controlled conditions. In each case the system is 
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readily operated by staff without a need for a lengthy training period. 
Information derived from operation of the system also serves to provide 
for useful management and product information enabling, for example, 
changes in customer preferences to be identified to enable, for example, 
5 increased production or stocking to be achieved promptly for goods of 

increasing popularity. Typically where mismatching occurs, that is to say a 
sample provided by a customer cannot be related to an existing product, 
the frequency of mismatching can be established so that where the 
frequency in relation to a particular colour of product exceeds a threshold 
10 - value it may be deemed necessary to manufacture or otherwise create a 
supply of the previously unavailable product. 

The proposed method and apparatus can also be used to provide for input 
to the internet or to local network systems for displaying colour and finish 
15 information such as in a virtual display system of a furnished interior. 
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CLAIMS . .; ... . .-,,',„ . 

1 A method of providing information relating to the appearance of a 
first coloured article falling in the family of the type described to 
enable a second coloured article from the family to be selected or 
identified which can be related in a predetermined way to the first 
characterised by the steps of: 

scanning the first article to establish colour and light 
information and thereafter to provide an output in the form of 
derived information giving at least one of the parameters defining 
hue, tone and light intensity; 

relating the derived information to established parameter or 
parameters located in one or more ranges of such parameters to 
identify the required parameter or parameters of the second article is 
either by direct correspondence or by way of a predetermined range 
' of such parameters such as provided by a colour circle or a range of 
colours in the visible light spectrum; the relationship between the 
colour/light information of the second article relative to the first 
being one being either identity, partial identity or a relationship such 
as by being a complementary or a contrasting colour. 

2 A method as claimed in Claim 1 characterised by the further step of 
relating the derived information to established parameter or 
parameters either be by way of comparison with information stored 
as data or with information in the form of physical samples such as 
colour samples of fibrous material such as Chromatone (RTM). 

3 A method as claimed in Claim 1 or Claim 2 wherein in the scanning 
stage is characterised by the step of establishing parameters for other 
aspects of the appearance of the first coloured article such as type 
and form of surface texture, whether the appearance lies somewhere 



on a scale extending between mat or glossy, between metallic or dull, 
between coarse or fine weave or between limiting values of some 
other visually significant attribute or attributes. 

Apparatus for undertaking the method as claimed in any preceding 

claim of the first step characterised by: 

a locating means adapted to locate the first article; 

a scanner mounted relative to the locating means and adapted to 

scan a first article and to provide the derived output information; 

a processing means adapted to receive the derived information and 

to relate the established parameter or parameters to one or more 

ranges of such parameters either by direct comparison with a 

physical sample or with entries in a range of such parameters held as 

a data base to identify the required parameter or parameters of the 

second article as aforesaid. 

Apparatus as claimed in Claim 4 characterised in that the processing 
means involves the Chromatone (RTM) colour scale whether in terms 
of physical samples from a range of such or in the form of a data 
base. 



U.S. Patent Oct. 5, 1999 Sheet 1 of 9 5,961,324 



FIGURE 1 (PRIOR ARTi 




U.S. Patent 



Oct. 5, 1999 Sheet 2 of 9 

o 



5,961,324 




38 
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FIGURE 4 
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FIGURE 9 
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TOOTH SHADE ANALYZER SYSTEM AND 
METHODS 

RELATED APPLICATION 1 

This application is a continuation-in-part of U.S. appli- 
cation Ser. No. 08/494,979, filed on Jun. 26, 1995, now U.S. 
Pat. No. 5,766,006, entitled "Tooth Shade Analyzer System 
And Methods", and which is expressly incorporated herein 
by reference. 

BACKGROUND 

In dentistry, there has been a shift in recent years from a 
philosophy. of drilling and filling to one of prevention and 
cosmetics. By way of example, many people today are 
choosing to have clinical procedures done to enhance their 
smile and appearance. Most of these procedures involve the 
modification of tooth shape, alignment, and/or color. 

A necessary step in altering a patient's tooth color is to 
determine the "shade'' of the existing tooth. For example, 
those persons seeking a whiter, brighter smile are still 
assessed to establish their existing tooth color so that an 
appropriate before and after comparison can be made. Shade 
determination is even more important for those persons 
seeking reconstructive work, since one goal of the recon- 
structive process is to achieve a natural appearance. 
Therefore, it is important to know the existing tooth shade 
so that it can be accurately matched with the new restoration. 

The dental profession utilizes standardized shade guides 
created by those companies which manufacture the recon- 
structive materials. One well-known shade guide is the 
Vita™ shade guide, which includes sixteen different shades. 
Other, less popular shade guides include; those guides pro- 
vided by Bioform™ and SR-Vivadent™. 

These shade guides are utilized in a rudimentary fashion. 
The guide itself is a plastic plate with a plurality of remov- 
able color tabs that are shaped like a tooth, e.g., the front 
tooth. Typically, to assess a patient's tooth shade, a dentist 
removes one of the colored tabs and holds it up to the 
patient's tooth so that she can "eyeball" the closest match 
possible. Understandably, there are many variables to this 
method, some of which stem from the subjectivity of the 
dentist making the eyeball assessment. 

Once the tooth shade is determined, the information is 
used relative to the particular procedure needed. In bonding 
or filling a tooth, for example, the composite materials 
required. for the restoration are specified within the range of 
the shade guide, e.g., one of sixteen shades for the Vita™ 
range. More particularly, if a crown, bridge or denture is 
needed, the patient's shade must be determined and com- 
municated correctly to the lab that make the crown, bridge 
or denture. 

The communication of shade information between the 
dentist and the lab is extremely important. Often, there is a 
break-down or failure in this communication, resulting in a 
poor shade match for the patient. In some cases, a particular 
dentist utilizes an uncommon shade guide, thereby leaving 
the lab technician to eyeball and convert the shade infor- 
mation to a Vita standard shade (since porcelain is often 
made from the Vita™ shade guide). ^This too can result in 
improper shade matching. 

Hie process for selecting the porcelain for a particular 
tooth shade illustrates the difficulty in assessing and manu- 
facturing the correct color match. If, for example, a crown 
of Vita™ shade A3 is desired, porcelain is built by hand with 
a paint brush onto a model of the tooth to be restored. The 
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porcelain is built in layers on the model to achieve translu- 
cency and natural appearance. Each layer has a particular 
color and intensity associated with it: To generate shade A3, 
the technician follows a "recipe" that is given by the 

5 manufacturer Vident™, requiring a different shade for each 
layer of porcelain applied. If a doctor asks for a shade that 
is not a Vita™ standard shade, the technician typically seeks 
to achieve that shade by combining different porcelain shade 
combinations together, to increase or decrease the chroma, 
hue and value of the shade. 

To further complicate the color-matching process, same 
dentists are simply not skilled in taking and determining 
shade information. Therefore, these dentists sometimes send 
their patients directly to the lab where the technician can 
determine the shade information. Alternatively, these den- 
tists sometimes have a technician come to the office. In 
either event, there is, at times, one more level of subjective 
uncertainty injected into the correct match and determina- 
tion of a patient's tooth shade. 

^ 0 It is, accordingly, an object of the invention to provide a 
shade analyzer system which reduces the a fore -mentioned 
difficulties. 

Still another object of the invention is to provide meth- 
odology for assessing and communicating a patient's tooth 
25 color in an objective manner. 

These and other objects of the invention will become 
apparent in the description which follows. 

SUMMARY OF THE INVENTION 

, 0 In one aspect, the invention provides a system for deter- 
mining the tooth shade of a patient's tooth. An intraoral 
camera captures the image of the patient's tooth, including 
color information representative of the tooth 's color. A shade 
analyzer sub-system connects in electrical communication 

;5 with the intraoral camera, and has (i) a color processing 
section for determining the color of the patient's tooth from 
the color information of the image; (ii) storage memory for 
storing shade information representative of. a plurality of 
tooth shades (i.e., each of the tooth shades corresponds to a 

40 different tooth color), (iii) a color correlation section for 
comparing the color of the patient's tooth to the plurality of 
tooth shades and for identifying a tooth shade with a color 
corresponding to the color of the patient's tooth, and (iv) 
means such as a display terminal for communicating the 

45 identified tooth shade to a user of the system. 

In another aspect, the system includes a monitor used to 
display the color image to a user of the system. The shade 
analyzer sub-system thus communicates a tooth color rep- 
resentative of the identified tooth shade to the monitor, 

50 thereby providing a user of the system with a visual com- 
parison of the patient's tooth color with the color of the 
identified tooth shade. 

In a further aspect, the color processing section deter- 
mines RGB chromaticities of the color image, and each of 

55 the plurality of tooth shades has a corresponding RGB 
representation of the tooth color stored in memory. In such 
, an aspect, the color correlation section quantitatively com- 
pares the RGB chromaticities with the RGB representation 
of each of the tooth shades, and compares and identifies a 

6o tooth shade based upon an comparison of the chromaticities 
and the RGB representations. 

In still another aspect of the invention, the system asso- 
ciates one or more of the plurality of tooth shades with at 
least one standardized shade corresponding to a particular 

to manufacturer's porcelain product. Accordingly, the system 
communicates the standardized shade to a user of the system 
so that the desired tooth may be constructed. 



5,961,324 



The color correlation section of the invention can also 
identify a combination of tooth shades having a combined 
color corresponding to 1 the color of the patient's tooth. As 
.such,- the system can (i) associate each of the tooth shades in 
the combination with at least one standardized shade corre- 
sponding to an particular manufacturer's porcelain product, 
(ii) specify fractions of each of the standardized shades 
needed to form the combined color, and (iii) communicate 
information identifying the fractions of each of the tooth 
shades in the combination to a user of the system. 

The invention also provides a tooth shade analyzer system 
for determining the tooth shade of a patient's tooth. One 
section of the analyzer communicates with an intraoral 
camera of the type which captures the image of the patient's 
tooth, including color information representative of a color 
of the tooth. Other sections of the analyzer (i) determines the 
color of the patient's tooth from the color information of the 
image, and (ii) stores shade information representative of a 
plurality of tooth shades. A color correlation section com- 
pares the color of the patient's tooth to the plurality of tooth 
shades and identities one or more tooth shades with a 
combined color corresponding to the color of the patient's 
tooth. Finally, the system includes means for communicating 
with devices such as display monitors to communicate the 
one or more identified tooth shades to a user of the system. 
In this manner, the analyzer matches the patient's tooth with 
one or more corresponding tooth shades and assists in 
reconstructing the patient's tooth. 

The invention also includes a method for determining the 
tooth shade of a patient's tooth, including the steps of: 
capturing .the image of the patient's tooth with an intraoral 
camera, the image including color information representa- 
tive of a color of the tooth; determining the color of the 
patient's tooth from the color information of the image; 
comparing the color of the patient's tooth to a plurality of 
tooth shades, the tooth shades being stored in an electronic 
medium; identifying one or more tooth shades with a 
combined. color corresponding to the color of the patient's 
tooth; and communicating the one or more identified tooth 
shades to a user of the system. 

A further method of the invention compares the tooth 
shade of a patient's tooth after the patient's teeth are 
cosmetically whitened, including the steps of: capturing a 
first image of the patient's tooth with an intraoral camera 
before the tooth is cosmetically whitened, the first image 
including first color information representative of a color of 
the tooth; processing the color information of the image to 
determine the color of the patient's tooth; comparing the 
color of the patient's tooth to a plurality of tooth shades, the 
tooth shades being stored in an electronic medium; identi- 
fying one or more tooth shades with a combined color 
corresponding to the color of the patient's tooth; whitening 
the teeth; communicating the one or more identiried tooth 
shades to a user of the system; and viewing the patient's 
tooth on a monitor after the whitening step while simulta- 
neously displaying an image of the patient's pre-whitened 
tooth, to provide before and after imagery. 

In another aspect of the invention, a process is provided 
for manufacturing a reconstructive tooth for a patient, 
including the steps of: capturing the image of the patient's 
tooth with an intraoral camera, the image including color 
information representative of a color of the tooth; processing 
the color information of the image to determine the color of 
the patient's tooth; comparing the color of the patient's tooth 
to a plurality of tooth shades, the tooth shades being stored 
in an electronic medium; specifying one or more tooth 
shades, and any fractions thereof, having a combined color 



corresponding to the color of the patient 's tooth; and paintr 
ing one or more layers of porcelain onto a model of the 
patient's tooth, each of the layers of porcelain corresponding 
to the specified tooth shades and the fractions thereof. 

* The invention also includes a system for determining the 
tooth shade of a patient's tooth by utilizing color CCD 
cameras. In one aspect, a color CCD camera captures the 
image of the patient's tooth, including color information 
representative of a color of the tooth. A shade analyzer 

i° sub -system is connected for electrical communication with 
the CCD camera, and has (i) a color processing section for 
determining the color of the patient's tooth from the color 
information of the image, (ii) a storage section for storing 
shade information representative of a plurality of tooth 
shades, each of the tooth shades corresponding to a different 
tooth color, (iii) a color correlation section for comparing the 
color of the patient's tooth to the plurality of tooth shades 
and for identifying a tooth shade with a color corresponding 
to the color of the patient's tooth, and (iv) a section for 

-° communicating the identified tooth shade to a user of the 
system. 

In accord with the invention, the CCD camera can include 
three CCD arrays, each of the arrays collecting image data 
corresponding to a color selected from the group of red, 
2? green and blue. Alternatively, the CCD camera can include 
a single CCD array, including a plurality of proximately 
located pixels corresponding to a color selected from the 
group of red, green and blue, each of any group of three 
pixels having a different color associated therewith. 

The invention is next described further in connection with 
preferred embodiments, and it will become apparent that 
various additions, subtractions, and modifications can be 
made by those skilled in the art without departing from the 
scope of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

A more complete understanding of the. invent ion may be 
obtained by reference to the drawings, in which: 
40 FIG. 1 shows a prior art intraoral camera system; 

FIG. 2 illustrates a tooth shade analyzer system con- 
structed according to the invention; 

FIG. 3 illustrates a typical prior art tooth shade guide; 
45 FIG. 3A illustrates one tooth shade tab of the shade guide 
of FIG. 3; 

FIG. 4 illustrates a digital data block constructed accord- 
ing to the invention for specifying a tooth shade color, color 
image information, and an associated manufacturer, 
so FIG. 5 shows an operational use of the system of FIG. 2; 

FIG. 6 illustrates image averaging and specification 
techniques, according to the invention; 

FIG. 7 illustrates an image comparison on the system of 
FIG. 2; 

FIG. 8 illustrates a common aperature color CCD camera 
and handpiece constructed according to the invention, and 
which form another embodiment of a shade analyzer system; 
and 

60 FIG. 9 shows an alternative CCD array technology, 
according to the invention, and which Is suitable for use 
within the camera of FIG. 8. 

DETAILED DESCRIPTION OF THE DRAWINGS 

o5 The use of intraoral video and/or imaging systems 
(hereinafter "intraoral camera system") has grown rapidly in 
dentistry over the past few* years. Such systems are widely 
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utilized in "show and tell" settings, i.e., where the dentist can 
show and illustrate particular features of a patient's mouth. 
However, these intraoral' camera systems arc rapidly becom- 
ing key to complex diagnostic and treatment planning. 
Presently, approximately 30% of the practicing dentists in 
the age group between about 35-54 own and utilize intraoral 
camera systems. It is expected that that percentage will only 
increase with increased familiarity. See Dental Pfvducrs 
Report, pgs. 22-24, February 1995. 

FIG. 1 illustrates a typical prior art intraoral camera 
system 10. The system 10 includes a wall-mounted intraoral 
camera 12, which includes twin halogen lamp light source 
(not shown) for uniform illuminance, one or more hand- 
pieces 14a, 14b, a digital video processor 16 (typically an 
IBM-compatible PC), which includes a hard drive 18 and 
floppy drive 20, and a color video monitor 22. 

In operation, a dentist points a selected handpiece 14a, 
146 at the target location within the patient's mouth to 
illuminate and view the resulting, full color image on the 
monitor 22, The endoscope handpieces 14a, 14£> come in 
varying styles, including a wide angle configuration, e.g., a 
100 degree field. of view (FOV) for posterior and anterior 
views, and a near 0 degree FOV for full-arch and full-face 
images. The processor 16 provides storage for any selected 
image, and can further display selected close-ups on the 
monitor 22 through zoom capabilities. 

There are several manufacturers of intraoral camera 
systems, offering an array of features. For example. 
Insight™, of San Carlos, Calif., offers a Power 0/100 similar 
to the one shown in FIG. 1. Other manufacturers include 
Cygnus Instruments, Inc. (CygnaScope™), of Goleta, Calif. 
VistaCam™ is yet another prior art intraoral camera system 
that incorporates a 90-degree FOV fiberoptic handpiece that 
delivers full color images from about 6 mm, i.e., the size of 
one typical tooth, to an image of the patient's whole smile. 

Therefore, the prior art intraoral camera systems 
described above offer full color imagery of a patient's tooth. 
The image may be stored on disk 18, 20 and/or displayed on 
the screen 22- 

The invention makes use of an intraoral camera system of 
the type described above. Specifically, FIG. 2 illustrates one 
embodiment of the invention and which shows a tooth shade 
analyzer 29 including an intraoral camera 30, associated 
handpieces 32a, 32/?, and a shade-analyzer subsystem 34. 
Preferably, the subsystem 34 is a digital video processor that 
is similar to the processor 16 of FIG. 1, and thus preferably 
includes the video processing capabilities of the processor 
16, such as known to those skilled in the art. A storage 
medium 36, such as a hard disk 18 or floppy 20, stores digital 
color images of a plurality of tooth shades, such as each of 
the sixteen shades of the Vita™ shade guide. The storage 
medium 36 further stores any images collected by a user of 
the system 29. 

The storage of the digital color images of one or more 
shade guides is relatively straight -forward. In particular, 
FIG. 3 illustrates one shade guide 38 having sixteen separate 
tabs 40. Each of the tabs 40 is removable from the guide 38 
so that it can be ported and viewed next to the patient's teeth. 
FIG. 3A illustrates one tab 40 that is removed from the guide 
38. The tab holder 40a typically includes color information 
about the selected tab 40, here shown as shade "A2." 

In accord with the invention, each of the labs 40 arc 
illuminated by one or the handpieces 32a or 32£> so that a 
color image is caprured and stored in the medium 36. The 
image is accompanied by associated information about that 
shade, such as the manufacturer type, e.g., the Vita shade 
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guide, and the particular shade, e.g.. ;*A2." For example, 
FIG. 4 illustrates one storage block 42 of data for storage as 
digital memory and which is representative of one tooth 
shade. In particular,' block 42a includes digital color image 

5 information, block 12b denotes the particular tooth shade, 
e.g, "A2," and block 42c denotes the manufacturer name, so 
that the associated tooth shade porcelain can be purchased 
from the correct manufacturer. Generally, the blocks 42£, 
42c of data are represented by digital words that specify the 

10 information, while block 42a includes image data corre- 
sponding to both color and spatial information. 

Preferably, the color image data within the block 42a is in 
a RGB format (i.e., Red, Green, Blue digital format, such as 
known to those skilled in the art) which specifies a color 

15 pixel within the image to an accuracy exceeding the number 
and color spread of the selected shade guides. For example, 
if sixteen shades are stored within the memory*36, then the 
bit-specificity required of the color-coded data within the 
image block 42a should span and discriminate at least those 

20 sixteen shades of white. For example, if each color of the 
RGB is specified at 3 -bits each, then 256 standard colors are 
discernible by the system 29 to cover sixteen tooth shades. 
Greater color determination accuracy is achieved with 
increased color-coding. In addition, if all the manufacturers 

- 5 of tooth shades are loaded into the memory 36, then even 
more color-coded accuracy is required, e.g., 8-bit per RGB 
color. 

The display of the color" imagery within the digital data 
block 42a is known to those skilled in the art. Specifically, 
the RGB information within the data block 42a specifies the 
color for each pixel on the monitor 44, FIG. 2, which is 
similar in capability to the monitor 22 of FIG. 1. The 
particular video'driyer (not shown) used to drive the monitor 
44 specifies and controls the color and image display as 
" appro pri ate. The RGB format specifies a color correspond- 
ing to signals which produce a suitable color picture on the 
monitor having the reference colors defined by the RGB 
chromaticities. 

4(J Once the plurality of shades are loaded into memory 36, 
the system 29 is ready for use. FIG. 5 illustrates this process 
in more detail. A user illuminates the desired tooth 50, 
(illustratively shown outside of the patient's mouth) with the 
handpiece 32a such that an image 52 of the tooth 50 is 
. displayed on the monitor 44. Although this step of forming 
an image on the screen 44 is not required, it helps to assess 
the accuracy to which the camera 30 captured the image 52.- 
As above, this image data 52 is stored into a block such 
as block 42, FIG. 4. The shade analyzer subsystem then 

50 compares the digital information within the block of data 
representing the image 52 with the blocks of data represen- 
tative of the several tooth shades. In one embodiment, a 
comparison of the RGB values is made between the tooth 
image data 52 and the several shades to find a best fit or 

55 match. 

It is important to note that this process has several 
advantages over the prior art. In particular, as long as the 
same camera 30 captures the data of the tooth shades and the 
patient's tooth shade data, it does not matter that the stored 

60 image color within the processor 34 match the perceived 
color or hue observed by a typical human. That is, as long 
as the data captured by the system 29 correlates to the same 
reference, e.g., the same camera 30, the match between I he- 
image 52 and the plurality of tooth shades will be calibrated 

65 automatically. This is in contrast- to many of the prior art 
references, e.g., U.S. Pat. No. 5,383,020, which requires a 
sensitivity maxima of the human eye. The invention has no 
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corresponding limitation because the camera of the\system 
29 objectively gathers the data from the same, internal 
v source. Nevertheless, it is preferable that the color display 
and coding of the camera 30 correspond- to. natural and 
perceived colors so that the image appears normal to a 
viewer. 

Those skilled in the art should appreciate that the data 
from the plurality of tooth shades can also be loaded from a 
floppy disk into the subsystem 34. More particularly, the 
tooth shade data from the one or more manufacturers can be 
installed directly into the system 29 without physically 
capturing the image of each tooth shade, provided that the 
data is captured by a camera that is similar to the camera 30, 
or by a camera that is calibrated to within an acceptable 
margin to the camera 30. In this manner, a user of the system 
29, e.g., a dentist, need never have actual tooth shade tabs at 
the office. Rather, the system 29 is used to capture color data 
on the patient's tooth; and the stored tooth shade information 
within the system 29 is automatically extracted, including a 
manufacturer identifier. 

It is worth noting that not all tooth shade information is 
readily derived from the patient. In particular, unlike the 
tooth shades from the shade guides, which are very uniform 
in color, a patient's tooth can include a myriad of different 
shades. Tooth stains and the like alter the tooth's color 
spatially, so that a selection or integration of color is 
preferred. FIG. 6 illustrates one embodiment of the inven- 
tion for dealing with this non-uniformity. 

Specifically FIG. 6 shows a tooth image 60 of a patient's 
tooth on the monitor 44. Each pixel 62, which is grossly 
over-sized for illustrative purposes, corresponds to a differ- 
ent spatial location and color of the tooth's image 60. 
Accordingly, a user of the system 29 can select one of the 
pixels at the desired color by pointing and clicking a mouse 
pointer 64, via the mouse 66, at any selected location (the 
details of the mouse and mouse pointer are widely known to 
those skilled in the art without further reference hereto, and 
are shown for illustrative purposes only). This selected 
information is then stored with the block of data, e.g., block 
42b of FIG. 4. 

Alternatively, the image of the tooth 60 can be averaged 
over a selected area by selecting a particular region for 
which the color imagery is averaged. For example, if the 
tooth 60 is to be averaged over the two pixels identified by 
the outline 68, then the subsystem 29 averages the two RGB 
values and specifies the tooth shade match in block 42b as 
an average of the two. 

FIG. 7 illustrates another monitor 44* and subsystem 34' 
constructed according to the invention, each of which is 
similar to the monitor 44 and subsystem 34 of FIG. 2, 
respectively. In the illustrated embodiment, an image 70 of 
a patient's tooth is matched to the appropriate shade, as 
above, and then an image 72 of the matched shade is also 
displayed on the monitor 44'. The subsystem 34" further 
generates and displays the tooth shade identifying match, 
e.g., "A2," on the screen 44' so that the ordering information 
about the tooth reconstruction is easily ascertained. In the 
illustrated embodiment, a visual comparison between the 
tooth and the selected shade is made available to both the 
dentist and the patient. The display 44' can also display the 
particular porcelain product information. 

It should be apparent to those skilled in the art that the 
data and information displayed on the monitor 44' can also 
be downloaded to a printer 76, so that a permanent record of 
the exam is obtained in hard -copy form. 

In the event that the system 29 of FIG. 2 does not find a 
close match to one existing tooth shade, the subsystem 34 
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specifies a combination of tooth shades that correspond to 
the color of the patient's tooth image data, e.g., the image 52 
of FIG. . 5. Preferably* this information is determined in 
fractions of the appropriate shade, e.g., VS"A2" and l /h.*'C4" 

5 Such fractions are determinable, according to one embodi- 
ment of the invention, by comparing the RGB data within 
the plurality of tooth shade blocks 42b with the actual 
patient's tooth shade image information. If the RGB data of 
the patient's tooth is equal to the chromaticity sum of l /2~A2" 

10 and i /2"C4," then such a fraction is entered into the match 
data block 42b for the selected tooth shade, and displayed on 
the screen 44 for the user. The chromaticity mathematics 
used to combine and subtract colors is known to those 
skilled in the art. Further detail may be found with reference 

15 to "Television Engineering Handbook,"' edited by K. Blair 
Benson, McGraw-Hill (1986), which is incorporated herein 
by reference. 

The patient's tooth shade information is typically com- 
municated to a laboratory which manufactures the recon- 

-° st rue ted tooth via a plurality of porcelain coalings. This 
process of constructing porcelain layers onto a tooth model 
is known in the art; although the specification of the differing 
porcelain layers by data generated by an intraoral camera is 
specific to the invention. In the event that certain fractions 
of different porcelain layers are needed, such as described 
above, the system of the invention again provides and 
generates the appropriate shade fractions corresponding to 
the multiple layers. 

Other color theory details, including the adding and 

"° subtracting of multiple colors', may be found with reference 
to the following patents, each of which is expressly incor- 
porated herein by reference: U.S. Pat. No. 5383,020, 
entitled "Method and apparatus for determining the color of 
a translucent object such as a tooth;" WO 86- 03292, entitled 

^ "A spectrum-photometer device for exactly determining the 
colour of a dental plate and or dental pluggings;" U.S. Pat. 
No. 3,986,777 entitled "Tristimulus colorimeter for use in 
the fabrication of artificial teeth;" U.S. Pat. No. 4,654,794 
entitled "Methods for determining the proper coloring for a 

40 tooth replica;" U.S. Pat. No. 4,836,674 entitled "Method and 
apparatus for determining color, in particular of a dental 
prosthesis;" U.S. Pat. No. 5,231,472 entitled "Color match- 
ing and characterization of surface coatings;*' and U.S. Pat. 
No. 4,247,202 entitled "Automatic computing color meter." 

FIG. 8 illustrates another embodiment of the invention, 
and which includes a common aperature color CCD camera 
80. The camera 80 is commonly known as a "three-chip" 
color camera because of the three separate area CCD arrays 

- 0 (and preamplifiers) 82^, 826, 82c. Acomplex prism 83 splits 
the light energy entering through the aperture lenses 84a, 
84b into the three RGB color components. That is, each of 
the arrays 82 uniquely corresonds to one of the three color 
spectrums, such as Red. A housing 86 surrounds and protects 
the camera 80 from contact with external influences. The 
outputs from the three arrays 82a, 826, 82c connect to a 
common RS232 interface 88, which is in turn connected, via 
signal lines 89, to a digital video processor shade analyzer 
subsystem, such as described above. 

b0 The size of the camera 80 is small, typically about 40 mm 
"3 or less. One manufacturer of a camera 80 includes Richtcr 
Enterprises, of Del Norte, Colo., which makes the Model 
AD01 Common Aperture Camera. 

The front aperture section 90 of the camera 80 connects 

t>5 to a handpiece 92 — similar to the handpieces 32*/, 32/> 
described above — which is utilized by the dentist to illumi- 
nate and capture light imagery within the patient s mouth. 
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For example, one acceptable handpiece 92 is an endoscopic 
handpiece which .derives illumination from an external 
source 94; e.g., a lamp. The source is imaged through the 
endoscope to provide illumination 96 at the target area 
designated by the dentist; and the endoscope recaptures the 5 
light scattered from within the patient's mouth to form an 
image, in conjunction with the camera 80, at the several 
CCD arrays 82^7, 82b, 82c. 

Each of the CCDs 82a, 82b, 82c is coaligned with the 
other so that three distinct pixels, i.e., one each correspond- 10 
ing to R, G or B chromaticities, substantially view the same 
target point. Typically, each of the pixels specifies an 8-bit 
(or even 10-bit) color, so that, in total, the combination of the 
three arrays form a possible 256x256x256 colors. This 
provides sufficient resolution to discern several shades of 15 
white within the shade guides, so that a particular guide may 
be matched with a patient's tooth. 

Alternatively, the arrays of FIG. 8 can be replaced with a 
single array 100, FIG. 9 (as such, the prism 83 is also no 
longer required). Such an array 100 is popular in lower cost ~° 
Camcorder technologies. In one embodiment, the array 100 
has serial RGB pixels along each rwo of the array, here 
denoted as "*R," "G" and ' - B" within each pixel 102. This 
scheme reduces resolution; although it also reduces costs. As 
above, each of the three RGB pixels is utilized to assess and " 
determine shade color. 

It should be apparent to those skilled in the art that certain 
modifications can be made to the invention as described 
herein without departing from the scope of the invention. , Q 

In view of the foregoing, what is claimed as new and 
secured by the Letters Patent is: 

1. A system for determining the tooth shade of a patient's, 
tooth, comprising: 

an intraoral camera for capturing the image of the 35 
patient's tooth, the image including color information 
representative. of a color of the tooth, and 

a shade analyzer sub-system connected for electrical 
communication with the intraoral camera, the shade 
analyzer having 40 

(i) color processing means for determining the color of 
the patient's tooth from the color information of the 
image, 

(ii) storage means for storing shade information repre- 
sentative of a plurality of tooth shades, each of the 45 
tooth shades corresponding to a different tooth color, 

(iii) color correlation means for comparing the color of 
the patient 's tooth to the plurality of tooth shades and 
for identifying a tooth shade with a color correspond- 
ing to the color of the patient's tooth, and 50 

(iv) means for communicating the identified tooth 
shade to a user of the system. 

2. A system according to claim 1, further comprising 
monitor means connected for display of the color image to 

a user of the system, the shade analyzer sub -system further 55 
comprising means for communicating a tooth color repre- 
sentative of the identified tooth shade to the monitor means, 
thereby providing a user of the system with a visual com- 
parison of the patient's tooth color with the color of the 
identified tooth shade. t>a 

3. A system according to claim I, wherein the color 
processing means comprises means for determining RGB 
chromaticities of the color image, and wherein each of the 
plurality of tooth shades has a corresponding RGB repre- 
sentation of the tooth color, and wherein the color correla- 



tion means comprises means for quantitatively comparing 
the RGB chromaticities with the RGB representation of each 
of the tooth shades, the color correlation means comparing 
and identifying a tooth shade based upon an comparison of 
the chromaticities and the RGB representations. 

4. A system according to claim 1, further comprising 
means for (i) associating one or more of the plurality of tooth 
shades with at least one standardized shade corresponding to 
a particular manufacturer's porcelain product, and for (ii) 
communicating the standardized shade to a user of the 
system. 

5. A system according to claim 1, wherein the color 
correlation means further comprises means for identifying a 
combination of tooth shades having a combined color cor- 
responding to the color of the patient's tooth. 

6. A system according to claim 5, further comprising 
means (i) for associating each of the tooth shades in the 
combination with at least one standardized shade corre- 
sponding to an particular manufacturer's porcelain product, 
(ii) for specifying fractions of each of the standardized 
shades needed to form the combined color, and (iii) for 
communicating information identifying the fractions of each 
of the tooth shades in the combination to a user of the 
system. 

7. A tooth shade analyzer system for determining the tooth 
shade of a patient's tooth, comprising: 

means for communicating with an intraoral camera, the 
camera of the type which- captures the image of the 
patient's tooth, the image including color information 
representative of a color of the tooth, 

color processing means for determining the color of the 
patient's tooth from the color information of the image, 

storage means for storing shade information representa- 
tive of a plurality of tooth shades, each of the tooth 
shades corresponding to a different tooth color, 

color correlation means for comparing the color of the 
patient's tooth to the plurality of tooth shades and for 
identifying one or more tooth shades with a combined 
color corresponding to the color of the patient's tooth, 
and 

means for communicating the one or more identified tooth 
shades to a user of the system, the shade analyzer 
system thereby matching the patient's tooth with one or 
more corresponding tooth shades and assisting in 
reconstructing the patient's tooth. 

8. A method for determining the tooth shade of a patient's 
tooth, comprising the steps of: 

capturing the image of the patient's tooth with an intraoral 
camera, the image including color information repre- 
sentative of a color of the tooth, 

determining the color of the patient's tooth from the color 
information of the image, 

comparing the color of the patient's tooth to a plurality of 
tooth shades, the tooth shades being stored in an 
electronic medium, 

identifying one or more tooth shades with a combined 
color corresponding to the color of the patient's tooth, 
and 

communicating the one or more identified tooth shades to 
a user of the system. 
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